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It is known that the joint limit distribution of independent Wigner 
matrices satisfies a very special asymptotic independence, called free- 
ness. We study the joint convergence of a few other patterned matri- 
ces, providing a framework to accommodate other joint laws. In par- 
ticular, the matricial limits of symmetric circulants and reverse circu- 
lants satisfy, respectively, the classical independence and the half in- 
dependence. The matricial limits of Toeplitz and Hankel matrices do 
n °t seem to submit to any easy or explicit independence/dependence 
| notions. Their limits are not independent, free or half independent. 

1. Introduction. Wigner [11] showed how the semicircular law arises as 
the limit of the empirical spectral distribution of a sequence of Wigner ma- 
■ trices. See, for example, [2] and [1] for such results and their variations. 

Tj" \ Then researchers studied the joint convergence of independent Wigner ma- 

trices and the limit is tied to the idea of free independence developed by 
Voiculescu [10]. 

It appears that the study of joint distribution of random matrices has 
been mostly concentrated on Wigner type matrices. In [7], joint limits of 
| random matrices were studied and it was shown that there are some cir- 

cumstances where the limit may exist but may not be free. As one of the 
Referees pointed out, [8] considers the joint distribution of Vandermonde 
matrices and diagonal matrices and emphasizes the importance of studying 
joint distribution of other patterned matrices. 
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We study the joint convergence of p independent symmetric matrices with 
identical pattern. In particular, we show that the tracial limit exists for any 
monomial when the patterned matrix is any one of, Toeplitz, Hankel, sym- 
metric circulant or reverse circulant. The Wigner, symmetric circulant and 
reverse circulant limits are, respectively, free semicircular, classical indepen- 
dent normal and half independent Rayleigh. The Toeplitz and Hankel limits 
are not free, independent or half independent. 

In Section 2, we discuss some preliminaries on noncommutative proba- 
bility spaces and recall the notions of independence, freeness and half inde- 
pendence. In Section 3, we introduce the notion of words and colored words 
and state our main result. In Proposition 1, we show that under a mild 
condition, if the marginal limit exists then the joint limit exists and can 
be expressed in terms of the marginals with the help of words and colored 
words. In Section 3.2, we discuss some examples. Finally, in Section 3.3, we 
give a proof of Proposition 1. 

2. Noncommutative probability spaces and independence. A noncom- 
mutative probability space is a pair (A, (p) where A is a unital complex alge- 
bra (with unity 1) and <p:A — > C is a linear functional satisfying (f)(1) = 1. 

Two important examples of such spaces are the following: 

(1) Let (X, B, //) be a probability space. Let L(fi) = C\i <p<OQ -^ p (a*) be the 
algebra of random variables with finite moments of all orders. Then (L(/x), <^>) 
becomes a (commutative) probability space where <f> is the expectation op- 
erator, that is, integration with respect to fi. 

(2) Let (X,B,[i) be a probability space and let A = Mat n (L(/x)) be the 
space of n x n complex random matrices with elements from L(fi). Then <p 
equal to -E M [Tr(-)] or -[Tr(-)] both yield noncommutative probabilities. 

For any noncommuting variables x\, . . . ,x n , let C(x\,X2, ■ ■ ■ ,x n ) be the 
unital algebra of all complex polynomials in these variables. If a\, 02, ■ • • , a n & 
A, then their joint distribution ^{ ai } is defined canonically by their mixed 
moments ii {a ^{x h ■ ■ ■ x im ) = 4>(a il ■■■a im ). That is, 

^K}(^) = H p (i a i})) for ^eC(ii,x 2 ,...,x n ). 

Convergence in law. Let (A n ,<j) n ), n> 1, and (A,(j)) be noncommutative 
probability spaces and let {a"}j e j be a sequence of subsets of A n where 
J is any finite subset of N. Then we say that {a™}j £ j converges in law to 
{ai}i£j C A if for all complex polynomials P, 

hm »{a?} ieJ (P)=V{a i } ie j(P)- 

To verify convergence in the above definition, it is enough to verify the 
convergence for all monomials q k > 1. 
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Independence and free independence of algebras. Suppose {Ai}i£j C A 
are unital subalgebras. They are said to be independent if they commute and 
(j>(ai ■■■a n ) = 4>(a\) ■ ■ ■ 4>(a n ) for all a» G A k (i) where i / j k(i) ^ k(j). 

These subalgebras are called freely independent or simply free if 4>( a j) = 0) 
aj 6 Aij and ^ ij+i for all j implies (f)(a\ ■ ■ ■ a n ) = 0. The random variables 
(or elements of an algebra) (a\, ■ ■ ■) will be called independent (resp., free) 
if the subalgebras generated by them are independent (resp., free). 

Half independence of elements of an algebra. Half independence arises in 
classification results for easy quantum groups and some quantum analogue 
of de Finetti's theorem. We closely follow the developments in [3]. We shall 
see later how this half independence arises in the context of convergence of 
random matrices. To describe this, we need the concepts of half commuting 
elements and symmetric monomials. 

Half commuting elements. Let {aj}j e j C A. We say that they half com- 
mute if aiOjak = akajOi, for all i,j,k € J. Observe that if {ajjigj half com- 
mute then a? commutes with aj and a 2 for all i,j € J. 

Symmetric monomials. Suppose {aj}j e j C A. For any k > 1, and any 
{ij} C J, let a = a^a^ ■ ■ ■ ai k be an element of A. For any i € J, let Ei(a) 
and Oi{a) be, respectively, the number of times a, has occurred in the even 
positions and in the odd positions in a. The monomial a is said to be sym- 
metric (with respect to {aijiej) if Ei(a) = Oi(a) for all i £ J. Else it is said 
to be nonsymmetric. 

Half independent elements. Let {aj}j S j in (A, (ft) be half commuting. 
They are said to be half independent if (i) {a|}jgj are independent and (ii) 
whenever a is nonsymmetric with respect to {aj}j 6 j, we have 4>{a) = 0. 

Remark 1. The above definition is equivalent to that given in [3], al- 
though there is no notion of symmetric monomials there. As pointed out 
in [9], the concept of half independence does not extend to subalgebras. 

Example 1. This is Example 2.4 of [3]. Let (ft,B,fi) be a probability 
space and let {r/i} be a family of independent complex Gaussian random 
variables. Define a { £ (M 2 (L(fj,)), E[Tr(-)]) by 



These {aj} are half independent. 

Remark 2. Let X, Y and Z be three self-adjoint elements of (A,(f>) 
such that <t>(X) = <p(Y) = <j>{Z) = but (j)(X 2 ),(p(Y 2 ),(j)(Z 2 ) ^ 0. Following 
Remark 5.3.2 of [1]: 
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(i) If X, Y commute and are independent, then <p(XY) = and 
<f)(XYXY) = 4>(X 2 )4>(Y 2 ) / 0. 

(ii) If X, Y and Z are half independent, then (f>(XYZZXY) = 0. This 
happens since X appears two times in odd positions but zero times in even 
positions. 

(iii) If X, Y, Z are free, then (p(XYZXYZ) = 0. If they are half indepen- 
dent then cp(XYZXYZ) = 4>(X 2 )<j){Y 2 )(i)(Z 2 ) + 0. 

3. Joint convergence of patterned matrices. 

3.1. Some preliminaries and the main result. It is well known that the 
joint limit of independent Wigner matrices yields the freely independent 
semicircular law. At the same time, there are a host of results on the lim- 
iting spectrum of other matrices. Important examples include the sample 
variance-covariance, the Toeplitz and the Hankel matrices. The joint con- 
vergence of several sample variance-covariance matrices has also been in- 
vestigated in the literature. However, joint convergence does not seem to 
have been addressed in any generality. In particular, it is not clear what 
other notions of independence are possible when we consider the joint limit 
of (independent) matrices. 

Patterned matrices offer a general framework for which this question may 
be worth investigating. A general pattern matrix may be defined through a 
link function. Let d be a positive integer. Let Z be the set of all integers and 
let N be the set of all natural numbers. Let L n : {1, 2, . . . , n} 2 — > Z d , n > 1, be 
a sequence of functions such that L n+ \(i,j) = L n (i,j) whenever 1 < i,j < n. 
We shall write L n = L and call it the link function and by abuse of notation 
we write N 2 as the common domain of {L n }. For our examples later, the 
value of d is either 1 or 2. 

A typical patterned matrix is then of the form A n = (x(L(i,j))) where 
{x(i);i > 0} or {x(i,j);i,j > 1} is a sequence of variables. In what follows, we 
only consider real symmetric matrices. Here are some well-known matrices 
and their link functions: 

(i) Wigner matrix W n . L:N 2 — > Z 2 where L(i,j) = (min(i,j),max(i, j)). 

(ii) Symmetric Toeplitz matrix T n . L : N 2 — > 7L where L(i,j) = \i — j\. 

(iii) Symmetric Hankel matrix H n . L : N 2 — > Z where L(i,j) = i + j. 

(iv) Reverse circulant matrix RC n . L : N 2 — > Z where L(i,j) = (i+j) modn. 

(v) Symmetric circulant matrix SC n . L:N 2 — > Z where L(i,j) = n/2 — 
\n/2 — \i — j\\. 

In general, we assume that the link function L satisfies Property B. 

Property B. A(L) = sup n sup tgZ dSup 1<fc<n #{Z:l < / < n,L(k,l) = 
t} < oo. 

In particular, A(L) = 2 for T n , SC n , and A(L) = 1 for W n ,H n and RC n . 
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Now let (f2, B, p) be a probability space and let Xi )U : Q —¥ M n for 1 < % < p 
be symmetric patterned random matrices of order n. We shall refer to the 
p indices as p distinct colors. The (j, /c)th entry of the matrix Xi jU will be 
denoted by X ijn (L(j, k)). 

Assumption I. Let the input sequence of each matrix in the collection 
{Xj !n }i<j< p be independent with mean zero and variance 1 and assume 
they are also independent across i. Suppose the matrices have a common 
link function L which satisfies Property B and 

sup sup sup E[|Xj jn (L(m, l))\ k ] < c& < oo. 

nSN l<i<p l<m<l<n 

Suppressing the dependence on re, we shall simply write Xi for Aj jn . We view 
{^Xi}i<i< p as elements of (A n = Mat n (L(/i)), <f> n ) where <j) n = re _1 E[Tr]. 

Denote the joint distribution of {-^^i}i<i<p by fi n . Then {^^i}i<i<p 
converges in law if 

V-nifl) = 4>n{q) 

m 



l+k/2 



(2) =^ E midHh,h))X i2 (L(j 2 ,j 3 ))---X ik (L(j k ,j 1 ))] 

31,— Jk 

converges for all monomials q of the form q({Xi}i<i< p ) = X^ ■ ■ X, 



To upgrade to almost sure convergence, we also define 
^) = ^ 7 ^Tr[AV--X l J 



£ X il (L(j 1 ,j 2 ))X i2 (L(j 2 ,j 3 ))---X ik (L(j k ,j 1 )). 



n l+k/2 



All developments below are with respect to one fixed monomial q at a time. 

Circuit. Any ir : {0, 1, 2, . . . , h} — > {1, 2, . . . , n} with vr(0) = vr(/i) is a cir- 
cuit of length l(n) := h. The dependence of a circuit on h and re will be 
suppressed. A typical element in (2) can be now written as 

k 

n^(L(vr(j-l),vr(j))) 
-i=i 

If all L-values L(ir(j — l),7r(j)) are repeated more than once in (3), then the 
circuit is matched. If L values are repeated exactly twice, then it is called 
pair matched. If the L values are repeated within the same color, then it is 
color matched. 



(3) E 
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For q = Xi x Xi 2 ■ ■ -Xi k , let for convenience, the corresponding sequence of 
colors be denoted by {ci, c 2 , ■ . ■ , c^}. Also let H = {-it : ir is a color matched 
circuit}. Define an equivalence relation on H by defining tt\ ~<7 ^2 if and 
only if, Q = Cj and 

X Ci (L(7n(i - =X Cj (L(n 1 (j - l),vn(i))) 

^ X Ci (L(7T 2 (i - 1),7T 2 (*))) = X c .(L(7T 2 (j " l),7T 2 (i))). 

Colored words. An equivalence class induces a partition of {1,2,..., A;} 
and each block of the partition is associated with a color. Any such class 
can be expressed as a (colored) word w where letters appear in alphabetic 
order of their first occurrence and with a subscript to distinguish the color. 
For example, the partition ({{1, 3}, 1}, {{2, 4}, 2}, {{5, 7}, 1}, {{6, 8}, 3}) is 
identified with the word a^a^cid^cid^. A typical position in a colored 
word would be referred to as w Ci [i] . 

Let the class of all (colored) circuits corresponding to a color matched 
word w and the class of all pair matched colored words be denoted, respec- 
tively, by 

U Cq (W) = {7T I W Cl [i] = W C . [j] X Ci (L(7T(i - 1), 7T(i))) 

(4) =A Cj (L(vr(i-l),vr(j)))}, 

CW k{^) = {all paired matched (within same color) words w of length /c} 

( 5 ) (v ■ \ 

[k is even). 

All the above notions have the corresponding noncolored versions. For in- 
stance, if we drop the colors from a colored word, then we obtain a noncolored 
word. For any monomial q, dropping the color amounts to dealing with only 
one matrix or in other words with the marginal distribution. 

Let w[i] denote the zth entry of a noncolored word w. The equivalence 
class corresponding to w and the set of pair matched noncolored words will 
be denoted, respectively, by 

(6) U(w) = {ir:w[i] = w[j] o L(vr(i - l),vr(i)) = L(ir(j - 1),tt(j))}, 

(7) Wit (2) = {all paired matched words w of length k} (k is even). 

For any word w € CWfc(2), consider the noncolored word w' obtained by 
dropping the color. Then w' € Wk(2). Since we are dealing with one fixed 
monomial at a time, this yields a bijective mapping say 

(8) i; q :CW k (2)^W k (2). 
For any w € CWfc(2), define 

Pc„(w)= lim -rj— \n c Jw)\ if the limit exists. 

" n— s>oo n / 



JOINT DISTRIBUTION 



7 



Proposition 1. Let {Xj}i<,,< p be patterned matrices satisfying As- 
sumption I. Fix any monomial q = X^X^ ■ ■ ■ X{ k . Assume that, whenever k 
is even, 

(9) p(w) = lim , |H(w)| exists for all w G Wfc(2). 

(a) Then pc q {w) =p(ijj q (w)) and for any k, 

lim/2 n (g) = Y] p Cq {w) = a{x h ■ ■ ■ x ik ) (say) 

weCW k (2) 

with 

fc!A(L) fc//2 

\a(xu ■■■Xi,)\ < - — — — T7T7 if k is even and each color 
i v u i k )\ - ( fc / 2 )!2 fc /2 J 

appear even number of times 
= if k is odd or a color appears odd number of times. 

(b) E[\Jl n (q) - fl n (q)\ A } = 0(n~ 2 ) and hence lim n ^oo Jl n (q) = a(x h ■ --x ik ) 
almost surely. 

Remark 3. It is known from [4] that (9) holds true for Wigner, Toeplitz, 
Hankel, reverse circulant and symmetric circulant matrices. The quantity 
(k/2)\2 k / 2 a b° ve ^ S t ne total number of noncolored pair matched words of 
length k (k even). Often not all pair matched words contribute to the limit 
and in such cases, this bound can be improved. 

Consider the polynomial algebra C{a±,a2, ■ ■ ■ ,a p ) in noncommutative in- 
determinates {aj}i<j< p and define a linear functional 4> on it by 

0Oii ■ ••<!». ) = lim /inpQi ■ -Xi ). 

Then Proposition 1 implies we have convergence in law of ({^-X"j}x<i< p , 4> n ) 

to ({dj}i<j<p, <fi) where <p n equals -E[Tr(-)] or ^[Tr(-)]. In the latter case, 
the convergence is almost sure. 

Remark 4. Proposition 1 shows that the joint moments of pattern ma- 
trices can be expressed as functions of pair matched words or, in other words, 
pair partitions. [5] consider bosonic, fermionic and q-Brownian motions and 
show that the joint distribution of certain operators (in some appropriate 
sense) can be expressed as functions on the set of pair partitions. It would 
be interesting to investigate if there are connections between the two types 
of models. 

3.2. Some examples. From the above result, lim/2 n (g) = when k is odd 
or when there is a color which appears an odd number of times in the 
monomial q. Henceforth, we thus assume that the order of the monomial is 
even and each color appears an even number of times. 
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Example 2 (Wigner matrices). Joint convergence of the Wigner matri- 
ces was first studied in [10] and later many authors extended it. For details of 
the classical proof and further extensions, we refer the readers to [1]. Here we 
give a quick partial proof essentially translating the concept of noncrossing 
partitions that is used in the standard proof into words. 

Colored Catalan words. Fix k>2. If for a w E CWk(2), sequentially delet- 
ing all double letters of the same color leads to the empty word then we call 
w a colored Catalan word. For example, the monomial Xi A2X2A1A1X1 has 
exactly two colored Catalan words aifo^aicici and ai&2&2CiCiai. A colored 
Catalan word associated with X1A2X2A1X1X1A2X2 is ai62^2 a iCiCid2C?2 
which is not even a valid colored word for the monomial X1X1X1X1A2X2X2A2. 

Let {Wi}i<i< p be an independent sequence of n x n Wigner matrices satis- 
fying Assumption I. Then from Proposition 1 and Remark 3, {n _1//2 Wj}i<j< p 
converges in law to {aj}i<j< p . We show that {fli}i<i< p are free and the 
marginals are distributed according to the semicircular law. 

From Table 1 of [4], for noncolored words, p(w) equals 1 if w is a Catalan 
word and otherwise p(w) = 0. As a consequence, the marginals are semicir- 
cular. Now fix any monomial q = x% x Xi % ■ ■ ■ xi 2k where each color appears an 
even number of times in the monomial. 

Let w be a colored Catalan word. It remains Catalan when we ignore 
the colors. Hence from above, Pc q {w) = p(tp q (w)) = 1. Likewise, if w is 
not colored Catalan then the word ip q (w) cannot be Catalan and hence 
PC q {w) = p(ip q (w)) = 0. Hence, if CAT g denotes the set of colored Catalan 
words corresponding to a monomial q then from the above discussion, 

lim p n (q) = I CAT, I . 

n— >oo 

Any double letter corresponds to a pair partition (within the same color) by 
the equivalence relation ~c. It is known that the number of Catalan words 
of length 2k is same as the number of noncrossing pair partitions [denoted 
by NC 2 k(2)] of length 2k. See [4] and Chapter 1 of [1] for proofs. 

Since the elements of the same pair partition must belong to the same 
color, we have 

i cat «i= e n w 

ireNC 2k (2) (jj')6t 

This is precisely the free joint semicircular law corresponding to q (see The- 
orem 5.4.2 of [1]). 

Incidentally, since the number of noncolored Catalan words of length 2k is 
fc!(fc+i)P we have |a(x il • ••aJt 2fc )| < fcp+i)!' Coronar y 5 - 2 - 16 °f t 1 ] can hence 
be applied to claim the existence of a C*-probability space with a state (j> 
and free semicircular random variables {0^} in it. 
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Example 3 (Symmetric circulants). The case of symmetric circulant 
is rather easy. These matrices are commutative and so the limit is also 
commutative. 

Let {SCi}i<i< p be an independent sequence of n x n symmetric circulant 
matrices satisfying Assumption I. Then {n~ 1 / 2 SCi\i<i< p converges in law to 
{a-i}i<i<p which are independent and the marginals are distributed according 
to the standard Gaussian law. To see this, first recall that the total number 
of (noncolored) pair matched words of length 2k equals ™f = Cfc ( sav )- 
Further (see [4]), for any pair matched word w £ W2fc(2), 

p(w) =lim- Tj ^|n(it;)| = 1. 

Now consider an order 2k monomial where each color appears an even num- 
ber of times. Hence, from Proposition 1, for any fixed monomial q, 

hm p n (q)= V p Cq (w) = \CW 2k (2)\. 

w&CW 2k (2) 

Let I be the total number of distinct colors (distinct matrices) in the mono- 
mial q = Xi ± Xi 2 ■ ■ ■ Xi 2k . Let 2 x n, be the number of matrices of the ith color. 
Then the set of all pair matched colored words of length 2k is obtained by 
forming pair matched subwords of color i of lengths 2nj, 1 < i < I. Hence, 

I 

(10) 0On ■•■Oi») = n C '"»- 

8=1 

Thus if {a\, . . . ,a p } denotes i.i.d. standard normal random variables, then 
the above is the mixed moment E[]^[' =1 a^ n *]. 

Example 4 (Reverse circulant). It can be easily observed using the 
link function that the reverse circulant matrices are half commuting. This 
motivates the next theorem. 

Theorem 1. Let {RCi}i<i< p be an independent sequence of n x n re- 
verse circulant matrices satisfying Assumption I. Then {n~ 1//2 iZCj}i<j< p 
converges in law to half independent {aj}i<j< p 6 (M2(L(//)),E[Tr(-)]) where 
di = [-, V q] and rji are i.i.d. complex Gaussian. 

To prove the result, we need the following notion. 

Colored symmetric words. Fix k > 2. A word w £ CWk(2) is called col- 
ored symmetric if each letter occurs once each in an odd and an even position 
within the same color. Clearly, every colored Catalan word is a colored sym- 
metric word. 
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Proof of Theorem 1. Consider a monomial q of length 2k where 
each color appears an even number of times. From the single matrix case, it 
follows that p{w) = if w is not a symmetric word (see Table 1 of [4]). If w 
is not a colored symmetric word, then ip q {w) is not a symmetric word and 
hence for such w, pc q {w) = p(ip q (w)) = 0. Hence, we may restrict to colored 
symmetric words and then we have by Proposition 1(a) that 

lim fi n (q) = \ CS q (w)\, 

n— >oo 

where CS q (w) is the collection of all colored symmetric words of length 2k. 

The number of symmetric words of length 2k is k\. Let, as before, I be 
the number of distinct colors in the monomial and 2nj be the number of 
matrices of the ith color. All symmetric words are obtained by arranging 
the 2rii letters of the ith color in a symmetric way for i = 1,2, . . . ,1. 

It is then easy to see that these arguments imply that 

(11) \CS q (w)\ =m! x n 2 ! x ••• x ml. 

First, observe that if the monomial a^a^-'-a^ G (M2(L(p>)), E[Tr(-)]) is 
nonsymmetric, then 

ECTrfaijd^ •••a i J) =0. 

If instead q{{di}) = a^a^ ■ ■ -ai 2k is symmetric, then we have by half inde- 
pendence (Example 1), 

E(Tr{a h ■■■a i2k \) =n\\ x n 2 ! x • • • x n*! = lim fi n (q). 

So it follows from (11) that the joint limit is asymptotically half indepen- 
dent. Incidentally the moments {k\,k > 1} are the (2A;)th moments of the 
symmetrized Rayleigh distribution. □ 

Example 5 (Toeplitz and Hankel). Consider first the Toeplitz matrix. 
Since p(w) exists, from Proposition 1, we have the joint convergence for 
Toeplitz matrices. For any fixed monomial q, let SNC q be the colored sym- 
metric words which are not Catalan. Then we obtain the following: 

H a h ■ ■ ■ ai J = Yl Pc q { w ) 

wGCW k (2) 

™eCAT 9 weSNC q 

+ Y Pc q (w) 

other pair matched colored words 

= |CAT 9 |+ PC» 

weSCN q 

+ Yl Pc q {w). 

other pair matched colored words 
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Consider q(Xi,X2,Xs) = X\X2X?,X\X2Xj > where X±,X2 and X% are scaled 
independent Toeplitz matrices. From Table 4 of [4], 

Pc q {aib2Czaib 2 cz) = p^qia^c^a^c^)) = p(abcabc) = \. 

For this monomial, the only pair matched colored word possible is ai&2C3ai&2C3 
and hence ^(010203010203) = \ 7^ 0. Thus, the limit is not free. 

Now let q{X\,X2,X-&) = X\ X2X3 X2 X$X\. Then the only pair of matched 
colored word is 0162C3&2C3O1 and <$>{a.\ 0203020301) = Pc„(ai&2C3^2C30i) = 
p(abcbca) = |. On the other hand we have already seen that ^(010203010203) = 
\. Since the two contributions are not equal, the Toeplitz limit is not inde- 
pendent. 

If they had been half independent, then ^(010203010203) = 4>( a i )<M°2) x 
(j)(a%) = 1, but that is not the case. Thus, the Toeplitz limit is not free, 
independent or half independent. 

For Hankel matrices, the colored nonsymmetric words do not contribute 
to the limit. So for any fixed monomial q we have 

4>(a h ■■■a ik ) = \C AT q \+ ^ Pc q (w). 

W&SNCq 

That the Hankel limit is also not free, half independent or independent can 
be checked along the above lines by considering appropriate monomials and 
their contributions. It is interesting to note that Hankel matrices do not half 
commute and that is why even though the limits vanish on nonsymmetric 
words they are not half independent. 

3.3. Proof of Proposition 1. (a) Fix a monomial q = o({Xj}i<j< p ) = 
• • • Xi k . Since tp q is a bijection, 

U Cq (w) = U(tP g (w)) for w € CW k {2). 

Hence using (9), 

^ fe/2+1 l n c g ( w )l = |™ fc72+T l n (V'<?M)l =?(^W) =Pc q (w). 
For simplicity, denote 

Tj = E[X ll (L(j 1 ,j 2 ))X l2 (L(j2,j 3 )) ■ ■■X lk (L(j k ,j l ))} for j = (j u . . . ,j k ). 
Then 

( 12 ) = ^ £ J y 

h,—,jk 

In the monomial, if any color appears once, then by independence and mean 
zero condition, Tj = for every j. Hence, /x n (o) = 0. 

So henceforth, assume that each color appearing in the monomial, appears 
at least twice. Now again, if j belongs to a circuit which is not color matched, 
then Tj = 0. 
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Now form the following matrix M: 

M(L(i,j)) = \X n (L(i,j))\ + \X l2 (L(i,j))\ + ■■■ + \X ik (L(i,j))\. 
Observe that 

\T i \<E[M(L(j 1 ,j 2 )---M(L(j k ,j 1 )}. 

From Lemma 1 of [4], it is known that the total contribution of all circuits 
which have at least one three match, is zero in the limit. 

As a consequence of the above discussion, if k is odd, then j2 n (q) — > 0. 
So assume k is even. In that case, we need to consider only circuits which 
are pair matched. Further this pair matching must occur within the same 
color. If j belongs to any such circuit, then by independence, mean zero and 
variance one condition, Tj = 1. 

Then using all the facts established so far, 

lim Mq)= lim Yl E[X il (L( 7 r(0),7r(l)))--- 

it : 7r pair matched 
within colors 

xI^L^-l),^)))] 
xX lk (L(n(k-l),7r(k)))] 

= E Pc q {w). 

wGCW k (2) 

The last claim in part (a) follows since 

E pc 9 h= E p(M^))< E pH< {2k) lf^ )k ■ 

w&CW 2k {2) weCW 2k (2) w&W 2k (2) 

The last inequality above is shown in [4]. 

(b) For part (b), the following notions will be useful: I circuits 7Ti, 7T2, . . . , tti 
are said to be jointly matched if each L- value occurs at least twice across all 
circuits. They are said to be cross matched if each circuit has at least one 
L-value which occurs in at least one of the other circuits. We can write 



(is) E[\Mq)-Mq)\ i ] = ^ TI E E 

where 



7ri,7r2,7T3,7r4 



.1=1 



X 7T = X h (L(ir(0),ir(l)))---X ik (L(Tr(k-l),ir(k))). 



JOINT DISTRIBUTION 
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If (7Ti,7T2, VT3, ^4) are not jointly matched, then one of the circuits, say ttj, has 
an L value which does not occur anywhere else. Also note that EX^. = 0. 
Hence, using independence 



(14) 



E 



m 

,1=1 



-7T, 



EX n[ ) 



E 



n o 



-7T, 



EX 



0. 



If (m, 7T2, 7T3, 7T4) is jointly matched but is not cross matched then one of the 
circuits, say ttj is only self-matched, that is, none of the L-values is shared 
by the other circuits. Then by independence, 



(15) E 



i=i 



EX 



n - 



E 



(X^-EX^) J] (X ni -El 

i=im 



•TTl , 



0. 



Since {^Q,n}i<i< n satisfy Assumption I, E[rj^ =1 (X 7r; — EX^)] is uniformly 
bounded over all (tti, 7T2, tt^, it 4). 

The arguments given in [6] for Toeplitz and Hankel matrices can be ex- 
tended to our set up easily to yield the following: let Qk,4 be the num- 
ber of quadruples of circuits (tti, 1T2, ^3, 114) of length k such that they are 
jointly matched and cross matched with respect to L. If L satisfy Prop- 
erty B, then there exists a constant K such that Qk,4 < Kn 2k+2 . Using this, 
and (13)-(15), 



E[\ji n ( q )-ji n (q)\ 4 }<K 



n 



2k+2 



2fc+4 



n 



0(n~ 



Now by an easy application of Borel-Cantelli lemma Jl n (q) converges almost 
surely. 
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